2023
Visual Instruction Tuning
LLaVA paper: align LLMs with visual information through instruction tuning on image-text pairs, enabling multimodal understanding and reasoning.
Tagged with
multimodal learning
Explore machine learning papers and reviews related to multimodal learning. Find insights, analysis, and implementation details.
3
Papers Found
Papers Related to multimodal learning
2023
BLIP-2: Efficient Vision-Language Pre-training
Computer VisionNatural Language ProcessingDeep LearningMultimodal LearningBLIP-2Vision-Language Models
BLIP-2 leverages frozen image encoders and LLMs for efficient vision-language pre-training, achieving state-of-the-art multimodal performance.
2021
CLIP: Visual Models via Language Supervision
CLIP explained: contrastive learning on 400M image-text pairs enables zero-shot image classification and powerful vision-language understanding.